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Method and arrangement for determining parameters of a 
technical system 

5 The invention relates to a method and an 

arrangement for determining parameters of a technical 
system. 

During multichannel transmission and 
multichannel reception of signals , interference 
10 frequently occurs, for example, between the 
signals/ images . One typical example in this case is 
mixing of a voice signal with noise, which can present 
a major problem in telecommunications and in video 
conferences. The present invention thus relates to the 
15 field of signal separation in order, for example, to 
recover an original voice signal . 

Typical known techniques for separation of 
source signals based on mixed signals are based on time 
averaging or filtering of the signals. This 
20 intrinsically has disadvantages in terms of the 
computation complexity. » 
^ - Methods based on so-called blind channel 

J equalization (signal equalization without prior 

knowledge of the transmission channel) are also known, 
25 but these methods always require a certain amount of 
knowledge about the source signals, such as knowledge 
about their statistical distribution. 

The problem of signal separation also occurs, 
for example, when two speakers are speaking into two 
30 microphones positioned at a distance from one another, 
so that each microphone receives a mixture of the 
signals spoken by the two speakers. The problem thus 
arises of separating the signal mixture once again, 
that is to say of separating a set of superimposed 
35 input signals. L, Molgedey, H.G. Schuster, "Separation 
of a Mixture of Independent Signals using Time-Delayed 
Correlations" , Phys . Ref . Lett . 72, 3634 (1994) in this 
case discloses the following method: the problem of 
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separating n superimposed and correlated source signals 
(input signals) and at the same time of establishing 
mixing coefficients of the source intensities can be 
reduced to an intrinsic value problem, in which two 
symmetrical n x n matrices must be diagonalized 
simultaneously. The matrix elements are measurable 
time-delayed correlation functions. This intrinsic 
value problem can be solved by means of a neural 
network, in which case the learning rules for the 
lateral inhibiting interactions between the neurons can 
be established by means of a Liapunov function whose 
minima provide the (degenerate) solutions to the 
problem. 

This method has also already been applied to 
the acoustic input signals (see P. Ehlers, 
H.G. Schuster, w Blind Separation of convolutive 
mixtures and an application in automatic speech 
recognition" ,• IEEE Trans. Signal Proc. (1997), 

DE 195 31 388 CI discloses a signal separation 
method and a signal separation device for nonlinear 
mixtures of unknown signals (blind channel) , which is 
illustrated schematically in Figure 3. 

This German Patent relates to the separation of 
a signal mixture comprising the nonlinear 
superimposition of M unknown source signals XI, X2, 
where N (N £ M) different mixtures of M source signals 
XI, X2 including any interference signal which may be 
pre sent are suppl ied to a s ignal evaluat ion devi ce , 
which analyzes the signal statistically to establish 
the nonlinear transmission factors and using these 
calculated factors to reverse the mixing process , so 
that the N outputs of the signal separation device 
contain, as approximately as possible, the M source 
signals without superimpositions. 
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It thus becomes possible to treat nonlinear mixtures, 
in which the case the term nonlinear means that the 
source signals XI, X2 are mixed by means of an unknown 
nonlinear system G. The unknown system G is described 
by a so-called Vol terra series, and the signal 
separation device G-l establishes the coefficients in 
the Volterra series. Once this 
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is known, it is possible to unmix the signal mixture. 
Furthermore, the coefficients can be used for further 
analysis in order to determine the position or speed of 
the signal sources. 

The method which is known from this document in 
this case essentially comprises two steps: 

• Firstly, the nonlinear equations which are selected 
uniquely by the selectable degree of nonlinearity in 
the mixing process are solved by a sliding time 
window, and the solutions are averaged over this 
time. This time averaging process represents a major 
disadvantage of this known technique , since it 
increases the computation complexity, while at the 
same time ' increasing the time required for the 
calculation process. 

• Secondly, the potential formed from a sufficiently 
large number of different cumulants of the estimated 
output signals is minimized, with the values required 
to calculate the potential originating from a sliding 
time window whose length can be varied. In this case, 
it is assumed that the s mixing system varies 
sufficiently slowly that this change can be ignored 
in the calculation of the sought mixing factors. 
According to this German Patent, the second said step 
is carried out by constructing and minimizing a cost 
function. When the global minimum is reached, the 
optimum values, in this case the transmission 
factors, have been found. 

With regard to the time involved and the 
computation complexity, the method described i^ 
DE 195 31 388 CI is disadvantageous, since the time 
averaging process has to be carried out at the end of 
the first method step mentioned above. 

The present invention is thus based on the 
object of providing a method and an arrangement which 
allow the separation of superimposed, statistically 
mutually independent, acoustic signals with reduced 
computation complexity. 
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This obj ect is achieved by the method and by 
the arrangement having the features according to the 
independent claims. 

In a method for determining parameters of a 
5 technical system, by means of which method output 
signals* can be determined from a set of superimposed, 
statistically mutually independent input signals, the 
parameters are determined in such a manner that the 
statistical independence of the output signals is 
10 maximized. 

An arrangement for determining parameters of a 
technical system, by means of which system output 
signals can be determined from a set of superimposed, 
statistically mutually independent input signals, has a 
15 processor which is set up in such a manner that the 
parameters can be determined in such a manner that the 
statistical independence of the output signals is 
maximized. 

Advantageous developments of the invention 
20 result from the dependent claims. 

The parameters are preferably determined using 
an iterative method. 

In a further refinement, the parameters are 
elements in an unmixing matrix, by which the set of 
25 superimposed input signals is multiplied or else 
convoluted, by which means the output signals are 
formed. 

The optimization of the parameters in the 
unmixing matrix is preferably obtained by the following 
30 steps: 

- repetition of a time-delayed decorrelation 
calculation in order to determine the intrinsic values 
in the unmixing matrix, 
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- determination of the intrinsic values in the unmixing 
matrix for which cross -correlations assume a minimum 
value, and 

- carrying out cumulant minimization, with the 
intrinsic values determined in the previous step being 
used as start values for the cumulant minimization. 

The cumulant minimization can be used, for 
example, by training a neural network, or else by any 
other known minimization technique, such as gradient 
descent or Monte Carlo simulations. 

In one development, at least one diagonal 
parameter of the unmixing matrix is set to a 
predetermined value during the optimization of the 
parameters in the unmixing matrix, thus ensuring the 
stability of the minimization process with respect to a 
global minimum. 

The unmixing matrix is preferably limited to a 
finite impulse response, that is to say an FIR filter 
(Finite Impulse Response) is used to form the 
individual components of the unmixing matrix. The FIR 
filter may be either a causal FIR filter or else a non- 
causal FIR filter. 

Furthermore, the unmixing matrix is preferably 
stabilized by projection on to a unit circle during the 
cumulant minimization process. 

The developments apply not only to the method 
but also to the arrangement, in which case, in the case 
of the arrangement > the processor is in each case set 
up in such a manner that the corresponding method step 
can be or is carried out. 

The invention and its developments can 
advantageously be used for separation of superimposed, 
statistically mutually independent input signals, in 
particular acoustic input signals. 
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The method and the arrangement can be used for 
any desired number of input signals. 

Further advantages, features and 

characteristics of the present invention will now be 
5 explained in more detail using an exemplary embodiment 
and with reference to the attached figures of the 
drawings, in which: 

Figure 1 shows the use of a system for separation 
of superimposed, statistically mutually 

10 independent acoustic signals according to the 

exemplary embodiment, 

Figure 2 shows a schematic illustration of the 
system from Figure 1, and 

Figure 3 shows a signal separation device, which 

15 is known from the prior art (DE 195 31 388 CI) , 

for nonlinear mixtures of unknown signals. 

The statistical independence between the source 
signals (the original voice signal and the noise) , also 
referred to as input signals in the following text, is 

20 used to recover the original voice signal from a 
mixture of signals, and the inverse process to that of 
the dynamic system, which has resulted in the mixing of 
the signals, is trained essentially approximately (is 
learnt) . Two different mixtures of the voice signal and 

25 of the noise signal are obtained, for example, by means 
of two microphones 1, 2 (see Figure 1) which are at a 
distance from one another and/or are aligned in 
opposite directions. The so-called time-delayed 
decorrelation technique (TDD) is used to initiate the 

30 learning phase in the method, that is to say in order 
to determine and specify start values for the learning 
phase, which allows the computation complexity for 
cumulant minimization as described in the following 
text to be reduced, and allows the risk of local minima 

35 to be reduced. 
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Figure 1 shows two microphones 1, 2, which pick 
up a first input signal Zl(t) and a second input signal 
Z2(t). These input signals Zl(t) and Z2(t> can in turn 
each be mixed with one another and with noise, as is 
represented symbolically by a mixing matrix S (see 
reference symbol 3) in Figure 1, After reception and/or 
transmission, a set XI (t) and X2(t) of superimposed, 
statistically mutually independent input signals Zl(t) 
and Z2(t) is obtained. These signals are entered in a 
calculation unit 4, in which essentially two steps are 
carried out, as is represented symbolically by a 
calculation unit B (reference symbol 6) for the first 
step and a neural network 5 for the second .step. 

The calculation unit 4 determines two output 
signals Yl(t) and Y2(t), respectively, which are 
approximately equal to the input signals Zl (t) and 
Z2 (t) , respectively, when the parameters are set 
optimally in the calculation unit 4. In other words, 
when the parameters of the matrices which are used are 
set optimally in the calculation unit 4, this 
calculation unit 4 essentially carries out the inverse 
process to that of the dynamic mixing process, which is 
represented symbolically by the matrix S (reference 
symbol 3) . The exemplary embodiment relates to the 
optimization process for setting the parameters for the 
unmixing matrix. 

The parameters of the matrices in the 
calculation unit 4 are in this case optimized such that 
the statistical independence between the output signals 
Yl(t), Y2(t) obtained by the matrix process in the 
calculation unit 4 is maximized. To this end, the 
output signals Yl'(t) and Y2 (t) , respectively, are fed 
back to the calculation unit 4 (see the feedback loops 
7 and 8, respectively) . An iterative method is used to 
determine whether the statistical independence of the 
output signal Yl(t) and Y2 (t) , 
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respectively, has increased in comparison to the 
previous iteration step (so that the iteration is in 
the "right" direction, in the direction of the global 
minimum of a cost function, which will be described in 
the following text), or not. 
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Figure 2 shows a mathematical representation of 
the layout from Figure 1, in which case the mixing 
process 3 can be described mathematically by a matrix 
S(q), and the unmixing process, which is intended to be 
carried out. by the calculation unit 4, is symbolized by 
an unmixing matrix M(q) . 

Figure 2 thus illustrates the problem of 
separation of a so-called multichannel blind source 
(multiple channel source without a-priori knowledge) 
into two dimensions. In this case, it is assumed that 
the mixing system S(q), where q represents a unit 
delay, is stable and, at the same time, also has a 
stable inversion, that is to say it is a minimal phase 
system. Furthermore, it is assumed that the input 
signals Zl{t) and Z2 (t) (for example a voice signal and 
a noise signal) are statistically mutually independent 
and do not have a Gaussian distribution. The sets XI (t) 
and X2(t) of superimposed input signals Zl (t) and Z2 (t) 
are input signals to an unmixing system having an 
unmixing matrix M(q) whose parameters (matrix elements) 
are trained to maximize the statistical independence 
between the output signals Yl(t) and Y2 (t) . In this 
case, the term " training" means the well known learning 
process of, for example, a neuron network, which should 
be cited as an example of a technique to maximize the 
statistical independence. This is done by minimizing a 
cost function J(M) , which will be described further 
below. 

A cumulant cost function is formed, which 
minimizes the diagonal cumulant elements of the 
cumulant order 2-4: 
Dcum m J(M) = S S [c (i) nondiagf 

i»inondiag 

The following aspects of dynamic mixing by the 
mixing matrix S(q) need to be taken into account in 
this case: 
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- Stability of the unmixing system: 

This is achieved by limiting M(q) to a finite impulse 
response (FIR filter) . The stability of the FIR 
system M(q) can, furthermore, also be obtained by 
carrying out a projection on to a unit circle during 
the learning phase. Any non-causality of the 
inversion of S(q) which may be present can be 
compensated for by a suitable time shift (delay) to 
the input signal X(t) . 

- Uniqueness of the separated signals Y(t) : 

In the case of steady-state mixing processes, the 
original source signals are recovered by scaling. For 
dynamic unmixing, the risk of the separated signals 
Y{t) not being unique is even greater. It is obvious 
that, in the situation where Yl(t) and Y2 (t) are 
statistically mutually independent , any linear- 
filtered modification of these signals will also 
still be statistically independent. Additional 
information is therefore required in order to reduce 
the inherent ambiguity of the problem. 

- Gaussian deformation of the data: 

Algorithms on a cumulant basis for steady-state blind 
source separation effectively minimize or eliminate 
higher-order diagonal cumulants corresponding to the 
output signals Y(t). On the other hand, linear 
filtering leads to the data being deformed to a 
Gaussian distribution, with the higher-order 
cumulants moving in the 0 direction. This can thus 
lead to limit solutions, in which the cost function 
reaches local minimum, but with the desired actual 
separation (global minimum) not being achieved. In 
order to avoid this undesirable situation, the 
structure of the unmixing transfer function (unmixing 
matrix) M(q) is subject to a number of limitations. 
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In order to avoid the abovementioned problems, 
an approach is chosen in which at least one (or else 
all) of the diagonal elements is or are set to the unit 
value : 
5 Mll(q) « 1 
and 

M22(q) = 1. 

This assumption is exact if the mixing elements 
Sll (q) and/or S22 (q) likewise have a unit value "1" . 

10 Otherwise, it is assumed that Sll (q) and/or S22 (q) have 
stable inversions, which allows the diagonal elements 
to be scaled from M(q) to the unit value. This approach 
considerably reduces the ambiguity of a solution and, 
furthermore, effectively avoids the risk of excessive 

1.5* Gaussian-distribution deformation of the output 
signals. Even if,, as stated above, the limitation to 
the diagonal elements of M(q) is at first glance to be 
highly restrictive, this assumption is generally 
satisfied in practical use. One typical example is the 

20 removal of noise from voice signals on the basis of a 
recording using two microphones, with the microphones 
being physically separated from one another or one 
microphone pointing in the' direction of the speaker, 
while the other microphone points in the opposite 

25 direction, so that the second signal, facing away from 
the speaker, essentially includes only a noise signal. 

The cumulant approach is based on the direct 
determination of the diagonal cumulant, as is stated in 
the article mentioned initially by F. Ehlers and 

30 H. Schuster, "Blind Separation of convolutive mixtures 
and an application in automatic speech recognition" , 
IEEE Trans. Signal Proc. (1997), although this 
inherently has the disadvantage that numerical solution 
is highly complex. Suitable initialization is thus used 

35 for this minimization method. In order to determine 
start values 
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for the minimization method, the present invention uses 
the technique of time-delay decorrelation (TDD) for 
simultaneous decorrelation of two different time 
delays, in which case this TDD technique can be based 
on a suitable matrix intrinsic-value problem. As 
already stated, this TDD technique is used according to 
the present invention for initiation of the diagonal 
(cross-correlation) cumulant minimization problem. 

In summary, the method can be subdivided into 
the two following steps: 

1. Repetition of the TDD method on the basis of the 
intrinsic-value problem in the frequency domain 
for different delay pairs and determination of 
that solution for which the cross-correlation 
terms have a minimum value. 

2 . Initiation (start) of the diagonal cumulant 
minimization process on the basis of the start 
values (FIR parameters) determined in the above 
step. 

A number of major characteristics and 
advantages will be summarized once again in the 
following text: 

No a-priori knowledge of the signal 
characteristics is required, with the exception of 
the necessity for statistical independence. 
The stability of the dynamic unmixing system is 
ensured by the modulation of its components as an 
FIR filter. 

Excessive Gaussian distribution deformation is 
avoided by the approach of at least one of the 
elements in the mixing transfer function matrix 
(unmixing matrix) being set to the unit value, or 
being able to be scaled to the unit value, and 
since the cumulant minimization step (step 2) 
requires a large amount of computation complexity. 
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the learning algorithm, for example of a neural 
network, is initialized using the TDD method. 
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The following text contains a program in 
Matlab, Version 4 or Version [lacuna] , by means of 
which the exemplary embodiment described above can be 
implemented on a computer: 

5 

f unct ion [cost , outl , out2 ] =curruilant_costFIRa2 (par, input , pi , pll , p2 , p 
22,a3,a4) ; 

% [cost , outl , out2] =cumulant_costFIRa2 (par, input , pi , pll , p2 , p22 , a3 , a 
4); 

10 % cumulant cost 

% FIR representation used 

% filter function used in both directions (ncn_causal) 

[np,np] =size (par) ; 
15 firl=par(l:pl) ; 

f irll-par { 1+pl : pl+pll) ; 
fir2=par(l+pl+pll:pl+pll+p2) ; 
f ir22=par (pl+pll+p2+l :rrp) ; x 

den=l; %FIR only 

20 

outl= [input ( : ;1) -filter (firl, den, input (: ,2) ) -flipud(f ilter ( [0 
f irll] , [den] , f lipud(input ( : ,2) ) ) ) 3 ; 

%/std(input(l / :) ) ; %dlsim 

25 %f ilter 

out2= [input ( : ,2) -f ilter (fir2, den, input ( : ,1) ) -flipud (filter ( [0 
fir22], [den], 

f lipud(iiput ( : , 1) ) ) ) J ;%/std (input ( : ,2) ) ; 

%dlsim %f ilter 

30 

out [outl out2] ; 

%outl=outl/std(outl) ; % this scaling was not needed in exarrples 
in SIP98 paper 
%out2=out2/std (out2) ; 

35 

Ld=0; % number of delays in calculating the cross-correlation 

cost3=0; 

co©t4=0; 

costALLl= [] ; 
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costALL2= [] ; 
o!2=outl . *out2 ; 
cost2=mean(ol2) A 2; 

ol!2=outl . *outl . *out2 / 
ol22=outl . *out2 . *out2 ; 

if a3 ==1 

cost3= [mean(ol22) ] A 2+ [mean(ol22) ) A 2; 

end 

if a4 ==1 

cost4= [mean (oll2 . *outl) - 
3*mean{outl. A 2) *mean(o!2) ] A 2 + . . . 

[mean( (outl."2) .* (out2.^2) ) -2*mean(ol2) A 2- 
mean (out 1 . A 2 ) *mean (out2 . A 2 ) ] . . . 

[mean(o!22 . *out2) -3*mean(out2 . A 2) *mean(ol2) ] A 2 

end 

%cum4a= [cu^xtoutl^utl/Outl/Outl) ] A 2; 
%cum4b= [cum4x (out2 , out2 , out2 , out2 ) ] A 2 ; 



cost=cost2+a3*cost3+a4*cost4 ; 



%-cum4 



